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IMAGE RESTORING APPARATUS AMD METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to an image restoring 
apparatus and method for restoring (repairing) a deteriorated 
image to an undeteriorated image. 
2- nannHnMon of the Relate Aff; 

Conventionally, an image that is deteriorated in image 
quality is restored in such a manner that a model function of the 
deterioration is determined by analyzing the cause of the 
deterioration and an inverse function of the model function is 
applied to the deteriorated image. 

Various causes of deteriorations are conceivable such as 
a uniform movement of a camera (imaging device such as a video 
camera) and blurring caused by the optical system of a camera. 

Therefore, in restoring an image, different model functions 
should be used for respective causes of deteriorations. 

That is, unless the cause of a deterioration is found, it 
is difficult to restore a deteriorated image because a model 
function cannot be determined. 

Further, it is frequently the case that even if a model 
function of a deterioration is established, there is no inverse 
function for restoration that corresponds to the model function. 
In such a case, it is difficult to perform evaluation for 
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determining the optimum model . 

That is, although to restore an image that is deteriorated 
in image quality it is necessary to analyze the cause of the 
deterioration, determines a deterioration model function, and 
apply its inverse function to the deteriorated image, it is 
difficult to perform restoration if the cause of the deterioration 
cannot be found or an inverse function cannot be determined 
uniformly. 

SUMMARY OF THE TMVTTMTTnxf 

The present invention has been made in view of the above 
problems, and an object of the invention is therefore to provide 
an image restoring apparatus and method which can restore a 
deteriorated image even if the cause of the deterioration cannot 
be found or an inverse function cannot be determined. 

The invention has been made to attain the above object. An 
image restoring apparatus according to the invention is an 
apparatus for restoring an image (represented by a digital image 
signal) that is deteriorated in image quality, and comprises 
blocking means for dividing a deteriorated input image into a 
plurality of blocks and thereby generating block data (i.e., 
performing scan conversion on the input image) ; classifying means 
for classifying the block data as one of a plurality of classes 
and for outputting a class code corresponding to the class thus 
obtained; and undeteriorated image output means for outputting 
an undeteriorated image corresponding to the input image in 
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accordance with the class code (i.e., outputting data that has 
been optimized in advance by learning) . 

The undeteriorated image output means stores a table in which 
results (learned values) that have been obtained in advance by 
learning by using block data of an undeteriorated image and data 
obtained by classifying an image that was obtained by 
deteriorating the blocked, undeteriorated image according to a 
predetermined deterioration . function are correlated with 
respective class codes . Alternatively, the undeteriorated image 
output means stores a table in which results (learned values) that 
have been obtained in advance by learning by using data obtained 
by blocking and then classifying a deteriorated image and block 
data of an undeteriorated image are correlated with respective 
class codes . 

An image restoring method according to the invention 
comprises a blocking step of dividing a deteriorated input image 
into a plurality of blocks and thereby generating block data; a 
classifying step of classifying the block data as one of a 
plurality of classes and outputting a class code corresponding 
to the class thus obtained; and an undeteriorated image output 
step of outputting an undeteriorated image corresponding to the 
input image in accordance with the class code. 

The undeteriorated image output step takes out a learned 
value corresponding to the class code from a plurality of learned 
values that have been obtained in advance by learning by using 
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block data of an undeteriorated image and data obtained by 
classifying an image that was obtained by deteriorating the 
blocked/ undeteriorated image according to a predetermined 
deterioration function. Alternatively, the undeteriorated 
image output step takes out a learned value corresponding to the 
class code from a plurality of learned values that have been 
obtained in advance by learning by using data obtained by blocking 
and then classifying a deteriorated image and block data of an 
undeteriorated image . 

In the invention, results {a restoration table) that have 
been obtained in advance by learning by using data obtained by 
classifying an image-quality-deteriorated image on a block- 
by-block basis and block data of an undeteriorated image are 
stored. Since the table has been obtained by learning between 
the deteriorated image and the undeteriorated image, a 
deterioration-repaired image can be obtained by taking out a 
learned value corresponding to a class code generated by 
classifying a deteriorated image (i.e., replacing the 
deteriorated image with the undeteriorated image through mapping) . 
Once a table is generated, the only process to be executed for 
image restoration is to read out data from the table. Therefore, 
the process is made simple. 

BRIEF DESCRIPTION OT THE DRAWINGS 
Fig. 1 is a block diagram showing a general configuration 
of an image restoring apparatus according to a first embodiment 
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of the present invention; 

Fig. 2 is a flowchart showing a first specific example of 

learning according to the first embodiments- 
Fig. 3 is a flowchart showing a second specific example of 

learning according to the first embodiment; 

Fig. 4 illustrates prediction of an original signal image 

from a learning signal image; 

Fig. 5 is a block diagram showing a general configuration 

of an image restoring apparatus according to a second embodiment 

of the invention; and 

Fig. 6 is a block diagram showing a general configuration 

of an image restoring apparatus according to a third embodiment 

of the invention. 

DETAILED DESCRIPTION OF TKE PREFERRED EMBQnTMTTMT^ 

Several embodiments of the present invention will be 
hereinafter described with reference to the accompanying 
drawings • 

An image restoring apparatus according to a first embodiment 
of the invention is an apparatus for restoring an image 
(represented by a digital image signal) that is deteriorated in 
image quality and is composed of the following components as shown 
in Fig. 1. A blocking circuit 2 divides (i.e., performs scan 
conversion on) a deteriorated input image that is supplied from 
an input terminal 1 into a plurality of blocks. A class code 
generation circuit 3 is a classifying means for classifying block 



- 5 - 



data as one of a plurality of classes and outputting a class 
corresponding to the class thus determined. A ROM table 4 that 
is an undeteriorated image output means for outputting an 
undeteriorated image corresponding to the input image in 
accordance with the class code (i.e., outputting data that has 
been optimized in advance by learning) . 

The ROM table 4 stores results (learned values) of learning 
that has been performed in advance between block data of an 
undeteriorated image and data obtained by classifying a 
deteriorated image that was obtained by deteriorating the blocked, 
undeteriorated image according to a predetermined deterioration 
function (described later) , in the form of a table in which the 
learning results are correlated with the class codes (first 
specific example described later) . Alternatively, the ROM table 
4 stores results (learned values) of learning that has been 
performed in advance between data obtained by blocking and then 
classifying a deteriorated image and block data of an 
undeteriorated image in the form of a table in which the learning 
results are correlated with the class codes (second specific 
example described later) . The class code generation circuit 3 
determines coefficients of a formula representing a pattern that 
is closest to the input image by using a high-order polynomial 
(described later) as a model formula, and performs classification 
in accordance with the thus-determined coefficients. 

Before description of the configuration of the image 
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restoring apparatus according to this embodiment, a description 
will be made of learning and generation of a ROM table in image 
restoration. 

To perform image restoration by using a table that has been 
obtained in advance through learning, it is necessary to perform 
learning between a deteriorated image and an undeteriorated, 
clear image. 

For example, a deteriorated image for learning may be 
obtained by generating a flow image by moving a camera while fixing 
an object or generating a blurred image by defocusing a camera 
intentionally . 

Fig. 2 shows a first specific example of a process flow of 
learning that uses a deteriorated image. 

Referring to Fig. 2, an undeteriorated image is supplied 
at step S9. At the next step S10, the undeteriorated image is 
blocked. 

At stepSll, resulting block data of the undeteriorated image 
is deteriorated according to a known deterioration function. 
Then, at step S12, the block data is subjected to clustering, 
that is, classification. The classification is pattern 
classification using blocked image data. The process then goes 
to step S13. 

At step S13, training (learning) is performed between the 
undeteriorated block data generated at step S10 and the 
deteriorated and classified block data that has been generated 



at step S12. 

At step S14, it is judged whether learning has been 
repeatedly performed on all blocks that constitute the image to 
such an extent that every class learning has been performed 
sufficiently. If the judgment result of step S14 is no, the 
process returns to step S10. If it is yes, the process goes to 
step S15. 

At step S15, a mapping table is generated by using optimum 
values for the respective classes that have been obtained through 
the learning. The mapping table becomes the ROM table 4. 

While in the above first specific example a deteriorated 
image is generated by deteriorating an undeteriorated image 
according to a deterioration function, learning may be performed 
by using a deteriorated image that has been generated in advance 
by, for example, moving or defocusing a camera as mentioned above 
(second specific example described below) . Fig. 3 shows an 
example of a process flow of the latter case. 

Referring to Fig. 3, a deteriorated image that has been 
generated physically in advance and an undeteriorated image are 
supplied at steps SI and S2, respectively. At step S3, the 
deteriorated image is blocked. At step S4, the undeteriorated 
image is blocked at the same positions as in the blocking of step 



S3. 



At step SS that is executed after step S3, clustering is 
-performed, that is, block data of the deteriorated image is 
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classified. As in the case of the first specific example, the 
classification is pattern classification using blocked image 
data. 

At step S6 that is executed after execution of steps S4 and 
S5, training (learning) is performed between the block data of 
the deteriorated image and the undeteriorated image. 

At step SI, it is judged whether learning has been repeatedly 
performed on all blocks that constitute the image to such an extent 
that every class learning has been performed sufficiently. If 
the judgment result of step S7 is no, the process returns to steps 
S3 and S4 for the deteriorated image and the undeteriorated image, 
respectively. If it is yes, the process goes to step S8. 

At step S8, a mapping table is generated by using optimum 
values for the respective classes that have been obtained through 
the learning. The mapping table becomes the ROM table 4. 

There are several variations in terms of the manner of using 
block data of a deteriorated image and block data of an 
undeteriorated image in the learning. For example, an output may 
be produced by performing learning based on block data of a 
deteriorated image and block data of an undeteriorated image or 
by performing learning on a pixel-by pixel basis. Further, 
learning data maybe an input image itself or a difference between 
an input image and an output of a deterioration filter. 

Although actual data may be used in the classification in 
each of the first and second specific examples, in view of the 
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memory capacity it would ba more feasible to use data compression 
or the like in the classification. 

Examples of the method of data compression are adaptive 
quantization in accordance with the dynamic range of an image 
signal (called ADRC; described below) , differential quantization 
(DPCM) , and vector quantization (VQ) . 

In the ADRC/ a digital image signal is blocked, a dynamic 
range is determined that is defined by the maximum and minimum 
values of a plurality of pixel data that are included in each block, 
and pixel data in each block are coded with an allocated bit number 
that is adapted to the dynamic range determined for the block. 

More specifically, in the ADRC, a dynamic range (i.e., a 
difference between the maximum and minimum levels in a block) is 
determined that is defined by the maximum and minimum values of 
a plurality of pixels that are included in each block of one frame 
(or one field) . A variable quantization bit number that is 
adapted to the dynamic range is determined for each block . Coding 
codes are obtained by coding, with the above quantization bit 
number, minimum-value- subtracted Input data (re-quantization; 
the dynamic range is divided into equal parts of the compressed 
quantization bit number and the respective pixels in the block 
are coded into codes having closest levels) . Further, one of 
information on the dynamic range, the maximum value, and the 
minimum value is employed as an additional code . The coding codes 
and the additional code are thus obtained. 
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The clustering is realized in the following manner. 

The simplest classification method is a technique of using, 
for instance, a bit sequence itself of learning data in a block 
as a class number. However, this technique requires a ROM having 
an enormous capacity. 

Therefore, in this embodiment, the number of classes is 
reduced effectively while the properties of a signal pattern are 
maintained by using ADRC in the classification that is performed 
by using the signal pattern. 

Fig. 4 shows an example of prediction of an original signal 
pixel A from learning signal pixels a-c. The levels of the 
learning signal pixels a-c are represented by x^x,. Re-quantized 
data obtained by performing p-bit ADRC on the data Xl -x 3 are 
represented by qi -q„ and their dynamic range and minimum value 
are represented by DR and min, respectively. 

In this case, the class number (class code) "class" of this 
block is defined by Equation (1) . 



class = ^,(2")'' (l) 

The ADRC is an adaptive re-quantization method that was 
developed as a high-efficiency coding method for VTRs (video tape 
recorders) . This embodiment employs the ADRC in the generation 
of a classification code of a signal pattern beeause the ADRC 
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allows a local pattern of signal levels to be expressed 
efficiently in a short word length. 

A more general description will be made below. 

With a notation that x t x „ represent pixel levels of 

a learning signal and y represents a pixel level of an original 
signal, an n-tap linear prediction equation (2) having 
coefficients w„ w „ is set for each class. 

y - wix t + w lXl + . . . ♦ u n x n (2) 

The coefficients w. have not been determined before the learning. 

The learning is performed for a plurality of signal data 
for each class. When the number of data is m, Equation (2) 
(prediction equation) leads to Equation (3) . 

yk - w lX „ + W|Xk2 + ... + Wn x ta ( 3 ) 

where k - 1, 2, . .., m . 

When m > n, the coefficients w, w B are not determined 

uniquely, m this case, coefficients that minimize Equation (5, 
are determined by defining the elements of an error vector e as 
follows : 

en - y k - {w lXki + w 2 x,a + ... + WftXkn ) (4 ) 

where k « l, 2 m . This is a solution according to the lmM 

squares method. 



(ft *y 

e2 = 



(5) 



Now, partial derivatives of Equation (5) with respect to 
w t are obtained as Equation (6). 



de 1 m 



m 



(6) 



Since each w 4 should be determined so as to make Equation 
(«) «ro, a matrix equation (9) ±, obtained by using elements 
defined by Equations (7) and (8) . 



m 



(7) 




Prediction coefficients are determined by solving Equation 
(9) with respect to w t by using a common matrix solution such as 
a sweep-out method. Resulting prediction coefficients are 
stored in a ROM as data (ROM table 4) of an address "class." 

Next, the deterioration function will be described below. 

First, an image observation model in which noise is taken 
into consideration is assumed. The image observation model can 
be expressed as 

g « Af + n (10) 

where f is an original image, g is observation data, A is an 
observation process, and n is additive noise. 

Let Hi and H 2 represent a space to which the original image 
f belongs and a space to which the observation data g belongs; 
then, the noise n is an element of H 2 and the observation result 
A can be regarded mathematically as an operator to be applied to 
Hi or H 2 . Parameters f and g may be expressed as a function that 
is defined on an continuous region or an array that is defined 
on discrete points- In the latter case, f and g are a vector. 
The model of Equation (10) is called a continuous -continuous 
model when both of Hi and H 2 are a function space and a 
discrete-discrete model when both of them are a vector space. 

When Hi is a function space and H 2 is a vector space, the model 
of Equation (10) is called a continuous-discrete model. 

Where Equation (10) is a continuous-continuous model, it 
is expressed as Equation (11) . 
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(11) 



In Equation (11), f(x , y) ia an original image , g(x ^ y} ^ 
a deteriorated image, n(x, y) ia noise, and h(x, y, x' , y , is 
called a deterioration function. For example, a deteriorated 
image for a point light source f (x, y, - 5(x-«, y- p ) is h(x, y, 
a, 0) . Therefore, the deterioration function is also called a 
point spread function (PSF) . 

Where the deteriorated image of a point light source does 
not depend on the position of a point light source except for a 
parallel movement, the point spread function is a difference- 
type function h(x-x'. y -y< > and Equation (11J is expressed by a 
convolution as Equation (12) . 

tfU.v) = n.r~/i(.r -x\ v - v')/(.r\ v'.lf/rV/ + /t(.v,v) 

(12) 

This type of deterioration is called movement-invariant, 
Position-invariant, or space-invariant. There may occur a case 
that Equation (U, can be converted into a form of Equation (12) 
by variable conversion. 

There may be a deterioration that can be separated into parts 
in the x-axis and y-axis directions. Mathematically, this 
corresponds to a case where a deterioration function can be 
converted into a product form like Equation (13). 
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h (x, y, x' , y' ) = hi(x, x')h,(y, y' ) (13) 

This is called a separable kernel . Blurring in a photograph 
due to a uniform movement of a camera is an example of a 
deterioration that is movement- invariant and is expressed as a 
separable kernel. 

Where Equation (10) is a discrete-discrete model, it is 
expressed as in the following manner. For example, an N- 
dimensional vector that is formed by values of an original image 
f (x, y) at N sampling points is represented by f . Similarly, 
if N-dimensional vectors obtained from a deteriorated image g(x, 
y) and a noise image n(x, y) are represented by g and n, 
respectively, Equation (11) can be expressed approximately as 

g - Af + n (14) 

where A is an Nth-order square matrix representing the 
deterioration. 

When sampling points are given by lattice points fx*, yj 
ofN a xN a (-N), sampling values fix., y„) of f(x, y) can be expressed 
as a matrix [f] by arranging those as they are. Similarly, 
matrices tg] and [n] are obtained for the deteriorated image g(x, 
y) and the noise n(x, y) , respectively. If is assumed that the 
deterioration is a separable kernel as in the case of Equation 
(13). In this case, Equation (11) of a continuous-continuous 
model can be expressed approximately as Equation (IS) that is a 
discrete-discrete model. 

tg] - AitfJA, + [n] (15) 
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where A; and A, are N^h-order and N,th-order square matrices, 
respectively. 

When the deterioration A is movement-invariant, Ai and A, 
in Equation (IS) can be converted into diagonal matrices by 
discrete Fourier transform (DPT) if they are approximated by 
Toeplit* matrices. This corresponds to a case that the 
convolution of Equation (12) is converted into a product form by 
Fourier transform. 

Next, a continuous-discrete model in such that a 
deterioration is effected according to a continuous-continuous 
model and then a deteriorated image is converted into a vector 
g or a matrix [g] by sampling. Therefore, the expressions of 
Equations (11) and (IS) can be used in the first and second half 
portions, respectively. Alternatively, the two processes can be 
expressed collectively like Equation (16) . 



SiJ - r~r.h(x. y)/(jc t y)dxety + n, J 



(16) 



where g tj and n tJ are ijth components of [gj and [n] , respectively. 

As described above by using Equations (11) -(19) , there are 
many specific methods of expressing an image deterioration model . 

Returning to Fig. l, a description will be made of an example 
configuration of the image restoring apparatus according to the 
first embodiment that restores an image by reading out data from 
the ROM table 4 that has been constructed by the above-described 



learning. The configuration of the image restoring apparatus 
shown in Fig. 1 is for outputting deterioration-repaired pixels 
for an input deteriorated image. 

As shown in Fig. 1, a deteriorated digital image signal that 
is input to the input terminal 1 is supplied to the blocking circuit 
2. In the blocking circuit 2, the received digital image signal 
is divided into a plurality of blocks each consisting of a 
plurality of pixel data. 

Block data is supplied from the blocking circuit 2 to the 
class code generation circuit 3. in the class code generation 
circuit 3, a class of the received block data is determined based 
on its two-dimensional level distribution pattern and a class code 
of the thus-determined class is generated. 

The class code is supplied, as address data, to the ROM table 
4, which stores the above-described learned values (i.e., 
undeteriorated pixel data) . A learned value (undeteriorated 
Pixel data) corresponding to the class code (address) is readout 
from the ROM table 4 and then output from the output terminal 5. 

Tig. 5 shows a configuration according to a second embodiment 
of the invention in which a ROM table 9 stores block-unit learned 
values . 

In Fig. 5, an input terminal 6 to a class code generation 
circuit 8 are the same as the input terminal 1 to the class code 
generation circuit 3 of Fig. 1. On the other hand, while the ROM 
table 4 of Fig. 1 outputs non-block-unit data, the ROM table 9 
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of Fig. 5 outputs block-unit data. 

The undeteriorated, block-unit data that has been output 
from the ROM table 9 is supplied to a block decomposition circuit 
10. That is, since the output of the ROM table 9 is block-unit 
data, it is subjected to block decomposition in the block 
decomposition circuit 10. Decomposed data are output from an 
output terminal 11 as output data of an undeteriorated image. In 
the second embodiment, the ROM table 9 and the block decomposition 
circuit 10 constitute an undeteriorated image output means. 

Fig. 6 shows a configuration according to a third embodiment 
of the invention, which is directed to a case where learning has 
been performed in advance for the difference between the output 
of a restoration filter that repairs a deterioration by using an 
inverse function of a deterioration function and the output of 
a blocking circuit 13 that is the same as in Figs. 1 and 5. 

That is, in a class code generation circuit 16 of an image 
restoring apparatus according to the third embodiment shown in 
Fig. 6, classification is performed on a difference between an 
input image that has been blocked by the blocking circuit 13 and 
an output of the restoration circuit 14 obtained by filtering the 
same block image. 

In Fig. 6, an input terminal 12 is supplied with a digital 
image signal as in the case of the input terminals 1 and 6 of Figs. 
1 and 5. The digital image signal is blocked by the blocking 
circuit 13 that is the same as in Figs. 1 and 5. 
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An output of the blocking circuit 13 is supplied to the 
restoration filter 14 that restores an image deterioration by 
using an inverse function of a deterioration function . a filtered 
output of the restoration filter 14 is supplied to an adder 15 
as a subtraction signal. At this time, the adder 15 is also 
supplied with the output of the blocking circuit 13 as an addition 
signal. Therefore, the adder 15 produces a difference between 
the filtered block data and the block data that is not filtered. 

An output of the adder IS is supplied to the class code 
generation circuit 16. As in the case of the above embodiments, 
the class code generation circuit 16 determines a class of the 
block data that is output from the adder 15 based on its two- 
dimensional level distribution pattern and generates a class code 
of the thus-determined class. 

The class code is supplied, as address data, to a ROM table 
17, which stores learned values that have been obtained through 
learning by using difference data between undeteriorated pixel 
data and data obtained by filtering the undeteriorated pixel data 
with a deterioration filter. A learned value (undeteriorated 
pixel data) corresponding to the class code (address) is read out 
from the ROM table 17. 

The learned value that is output from the ROM table 17 is 
supplied, as an addition signal, to an adder 18 that is also 
supplied with the output of the filter 14 as another addition 
signal. As a result, the adder IS outputs undeteriorated pixel 
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data, which is then output from an output terminal 19. Therefore, 
in the third embodiment, the ROM table 17 and the adder 18 that 
is supplied with the output of the filter 14 constitute an 
undeteriorated image output means. 

Although in the third embodiment the classification is 
performed on the above-described difference, it is also possible 
to perform classification on, for instance, the output of the 
filter 14 that is produced for an input image. 

As described above, in the image restoration methods of the 
embodiments of the invention, an input image that is deteriorated 
in image quality is subjected to scan conversion (blocking) , and 
a class is generated based on resulting block image data. Data 
to be used for image restoration (i.e., data that has been 
optimized by learning) is output from a table that has been 
prepared by learning In accordance with the class (i.e. , a signal 
pattern), and a restored image is generated from the data thus 
output. A deterioration-repaired image is obtained in this 
manner. Therefore, a deteriorated image can be restored even if 
the cause of the deterioration cannot be found or an inverse 
function cannot be determined uniformly. 

Conventionally, an image that is deteriorated in image 
quality is restored by analyzing the cause of the deterioration, 
determining a deterioration model function, and applying its 
inverse function to the deteriorated image. In contrast, in the 
embodiments of the invention, to accommodate cases where the cause 
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of a deterioration can not be found or an inverse function of a 
deterioration model function cannot be determined uniformly, an 
image is restored by replacing a deteriorated image with an 
undeteriorated, that is, restored, image (through mapping) by 
using a restoration table that has been obtained in advance by 
learning instead of using an inverse function of a deterioration 
model function. 

In the embodiments of the invention, since an image is 
restored through mapping by using a learned table that stores an 
undeteriorated image, it is not necessary to determine a complex 
deterioration function nor its inverse function. In addition, 
once an image restoration table is generated, the only process 
to be executed is to read out data from the table. Therefore, 
the process is made simple. 

A restoration table can be generated by learning even in 
a case where an image cannot be restored according to conventional 
techniques because an inverse function of a deterioration 
function cannot be defined. 

Therefore, according to the image restoring apparatuses 
according to the embodiments of the invention, an image in which 
image quality deteriorations have been repaired can be obtained 
for, for instance, an image taken by a television camera. 

As described above, according to the invention, results of 
learning that has been performed by using data obtained by 
classifying, on a block-by-block basis, an image-quality- 
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deteriorated image and block data of an undeteriorated image are 
stored in advance. A deteriorated image is divided into a 
plurality of blocks, and resulting block data is classified as 
one of a plurality of classes and a class code corresponding to 
the thus-determined class is obtained. An undeteriorated image 
corresponding to the deteriorated image is output in accordance 
with the class code. Therefore, a deteriorated image can be 
restored even if the cause of the deterioration cannot be found 
or an inverse function cannot be determined uniformly. 
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WHAT Tg riJXJMRn Tg. 

1. An image restoring apparatus comprising: 
blocking means for dividing a deteriorated input image into 

a plurality of blocks and thereby generating block data; 

classifying means for classifying the block data as one of 
a plurality of classes and for outputting a class code 
corresponding to the class thus obtained; and 

undeteriorated image output means for outputting an 
undeteriorated image corresponding to the input image in 
accordance with the class code. 

2. The image restoring apparatus according to claim l, 
wherein the undeteriorated image output means stores results that 
have been obtained in advance by learning by using block data of 
an undeteriorated image and data obtained by classifying an image 
that was obtained by deteriorating the blocked, undeteriorated 
image according to a predetermined deterioration function so that 
the results are correlated with respective class codes. 

3. The image restoring apparatus according to claim 1, 
wherein the undeteriorated image output means stores results that 
have been obtained in advance by learning by using data obtained 
by blocking and then classifying a deteriorated image and block 
data of an undeteriorated image so that the results are correlated 
with respective class codes. 

4. An image restoring method comprising: 

a blocking step of dividing a deteriorated input image into 
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a plurality of blocks and thereby generating block data; 

a classifying step of classifying the block data as one of 
a plurality of classes and outputting a class code corresponding 
to the class thus obtained; and 

an undeteriorated image output step of outputting an 
undeteriorated image corresponding to the input image in 
accordance with the class code. 

5. The image restoring method according to claim 4, 
wherein the undeteriorated image output step takes out a learned 
value corresponding to the class code from a plurality of learned 
values that have been obtained in advance by learning by using 
block data of an undeteriorated image and data obtained by 
classifying an image that was obtained by deteriorating the 
blocked, undeteriorated image according to a predetermined 
deterioration function, 

6. The image restoring method according to claim 4, 
wherein the undeteriorated image output step takes out a learned 
value corresponding to the class code from a plurality of learned 
values that have been obtained in advance by learning by using 
data obtained by blocking and then classifying a deteriorated 
image and block data of an undeteriorated image. 
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ABSTRACT f>F THE nTSPT.n^TTPF. 
Results of learning that has been performed by using data 
obtained by classifying an image-quality-deteriorated image orl 
a block-by-block basis and block data of an undeteriorated image 
have been stored in advance as a table so as to be correlated with 
respective class codes, A deteriorated input image is divided 
into a plurality of blocks. Resulting block data is classified 
as one of a plurality of classes and a class code corresponding 
to the thus-determined class is generated. Data for image 
restoration is read out from the table in accordance with the class 
code. 
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